Web Survey Bibliography
Relevance & Research Question: Verbal and numeric labels in scalar questions have received a lot of scholarly attention. It is well documented that verbal orientation of scales and adding numbers to anchor the scales influence respondents’ answers. Little is known, however, about switching the scale directions within one questionnaire. This may affect the answers as some respondents miss the fact of the switch (Dillman et al. 2009).
Methods & Data: We test whether switching the verbal orientation of scales and whether the choice of a starting point of numbered scales affect the answers. For that purpose, two experiments will be implemented in the upcoming wave of the GESIS Panel, a probability-based offline recruited mixed-mode (online and mail) panel of the general population in Germany. The first experiment tests the effects of switching the direction of the scale (“strongly agree” to “strongly disagree” and vice versa). The second experiment tests different labeling options. It has three conditions: 1) verbal labeling for end points only and no numbers, 2) fully labeled, starting with 0 and 3) fully labeled, starting with 1.
Results: The field time of the questionnaire starts on December 12, 2013 and ends in the middle of January 2014. The results will be available at that point. The analysis plan for the first experiment is to examine measurement error by comparing means and response distributions. We expect these to differ due to switching as respondents overlook that the order has been reversed. Effects are expected to be more pronounced among respondents who tend to satisfice. Thus, we will compare respondent groups by motivation, cognitive ability, and panel tenure. For the second experiment we will examine the occurrence of a midpoint shift and which of the numbered scales is closer to the scale with polar labels only.
Added Value: This presentation will be of interest to survey researchers who work with online access panels as well as online access panel providers. Often the questionnaire is put together by multiple researchers or clients in which case using multiple scales and various numbering schemes within one questionnaire are very likely.
Web survey bibliography - Bosnjak, M. (25)
- Article Establishing an Open Probability-Based Mixed-Mode Panel of the General Population in Germany...; 2017; Bosnjak, M.; Dannwolf, T.; Enderle, T.; Schaurer, I.; Struminskaya, B.; Tanner, A.; Weyandt, K.
- Does Changing Monetary Incentive Schemes in Panel Studies Affect Cooperation? A Quasi-experiment on...; 2016; Schaurer, I.; Bosnjak, M.
- Web Surveys Versus Other Survey Modes: An Updated Meta-analysis Comparing Response Rates ; 2016; Wengrzik, J.; Bosnjak, M.; Lozar Manfreda, K.
- The Effects of Questionnaire Completion Using Mobile Devices on Data Quality. Evidence from a Probability...; 2015; Bosnjak, M.; Struminskaya, B.; Weyandt, K.
- A quasi-experiment on effects of prepaid versus promised incentives on participation in a probability...; 2015; Schaurer, I.; Bosnjak, M.
- Unplanned use of mobile devices in a probabilistic online panel survey: Patterns of use and implications...; 2015; Poggio, T.; Bosnjak, M.; Bandilla, W.; Weyandt, K.
- Survey participation via mobile devices in a probability-based online-panel: Prevalence, determinants...; 2014; Poggio, T., Bosnjak, M., Weyandt, K.
- Switching the polarity of answer options within the questionnaire and using various numbering schemes...; 2014; Struminskaya, B., Schaurer, I., Bosnjak, M.
- Sample composition discrepancies in different stages of a probability-based online panel; 2013; Bosnjak, M., Haas, I., Galesic, M., Kaczmirek, L., Bandilla, W., Couper, M. P.
- (Online) Access Panels: Types and Quality Standards; 2012; Bosnjak, M.
- Mobile Survey Participation Rates in Commercial Market Research: A Meta-Analysis; 2012; Bosnjak, M., Poggio, T., Becker, K. R., Funke, F., Wachenfeld, A., Fischer, B.
- Self-administered mobile surveys; 2011; Bosnjak, M.
- Use of new technologies in social research: Self-administered mobile surveys; 2011; Bosnjak, M.
- Self-administered mobile surveys: Usability and (non)participation; 2010; Scherrer, S., Bosnjak, M.
- Internet surveys; 2010; Couper, M. P., Bosnjak, M.
- Web Surveys; 2009; Bosnjak, M.
- Understanding the willingness to participate in mobile surveys: Exploring the role of hedonic, affective...; 2009; Bosnjak, M., Metzger, G.
- Measurement options, measurement error, and usability in mobile surveys; 2009; Pferdekämper, T., Bosnjak, M., Metzger, G.
- Compensating for low topic interest and long surveys: A field experiment on nonresponse in Web surveys...; 2007; Marcus, B., Bosnjak, M., Lindner, S., Pilischenko, S., Schuetz, A.
- Beyond response rates: Effects of different (Web-) survey implementation procedures on sample composition...; 2006; Bosnjak, M., Marcus, B., Schuetz, A., Lindner, S., Pilischenko, S.
- Survey Administration Effects? A Comparison of Web-Based and Traditional Written Self-Administered Surveys...; 2003; Bandilla, W., Bosnjak, M., Altdorfer, P.
- Understanding the Willingness to Participate in Online-Surveys - The case of E-mail questionnaires; 2002; Bosnjak, M., Batinic, B.
- (Non)Response bei Web-Befragungen; 2002; Bosnjak, M.
- Banner-advertised Web surveys; 2000; Tuten, T. L., Bosnjak, M., Bandilla, W.
- Current Internet science - trends, techniques, results. ; 1999; Reips, U.-D., Batinic, B., Bandilla, W., Bosnjak, M., Graef, L., Moser, K., Werner, A.